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Abstract 



In this paper, we investigate the error floors of non-binary low-density parity-check (LDPC) codes transmitted 
over the memoryless binary-input output-symmetric (MBIOS) channels. We provide a necessary and sufficient 
condition for successful decoding of zigzag cycle codes over the MBIOS channel by the belief propagation 
decoder. We consider an expurgated ensemble of non-binary LDPC codes by using the above necessary and 
sufficient condition, and hence exhibit lower error floors. Finally, we show lower bounds of the error floors for 
the expurgated LDPC code ensembles over the MBIOS channel. 



Gallager invented low-density parity-check (LDPC) codes Q]. Due to the sparseness of the parity check 
maUices, LDPC codes are efficiently decoded by the belief propagation (BP) decoder. Optimized LDPC codes 
can exhibit performance very close to the Shannon limit |2|. 

Davey and MacKay [3| have found that non-binary LDPC codes can outperform binary ones. In this paper, 
we consider the non-binary LDPC codes defined over the Galois field ¥ q with q = 2 m . 

A non-binary LDPC code C over ¥ q is defined by the null space of a sparse M x N parity-check matrix 
H = (hij) over ¥ q : 



The Tanner graph for a non-binary LDPC code is represented by a bipartite graph with variable nodes, check 
nodes and labeled edges. The v-tii variable node and the c-th check node are connected with an edge labeled 
h c ,v €= F<j \ {0} if h c _ v 7^ 0. The LDPC codes defined by Tanner graphs with the variable nodes of degree j and 
the check nodes of degree k are called (j, fc)-regular LDPC codes. It is empirically known that (2, k) -regular 
non-binary LDPC codes exhibit good decoding performance among other LDPC codes for q > 64 (4j- However, 
this is not the case for q < 64. In this paper, we consider the irregular non-binary LDPC codes which contain 
variable nodes of degree two for the generality of code ensemble. 

A zigzag cycle is a cycle such that the degrees of al the variable nodes in the cycle are two. In order to 
reduce the error floors of codes under maximum likelihood decoding, Poulliat et al. proposed cycle cancellation 



I. Introduction 
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0. The cycle cancellation is a method to design the edge labels in zigzag cycles so that the corresponding 
submatrices are nonsingular. We see that from the simulation results f5j the resulting codes have lower error 
floors under BP decoding. However, it is found in our analyses that some zigzag cycles, even if their submatrices 
are nonsingular, degrade decoding performance. In this paper, we analyze a condition for successful decoding 
of zigzag cycles under BP decoding over the memoryless binary-input output-symmetric (MBIOS) channel. 
Based on this condition, we propose a design method of selecting labels so as to eliminate small zigzag cycles 
which degrade decoding performance. 

In fl6), we analyze the decoding erasure rate in the error floors of non-binary LDPC codes over the binary 
erasure channel (BEC) under BP decoding. In this paper, we analyze the error floors of non-binary LDPC 
codes over the MBIOS channel. First, we expurgate non-binary LDPC code ensembles. Next, we show lower 
bounds for the symbol error rates in the error floors of the expurgated LDPC code ensembles over the MBIOS 
channel. More precisely, those lower bounds are derived from the decoding errors caused by the zigzag cycles. 
Furthermore, simulation results show that the lower bounds on symbol error rates are tight for the expurgated 
ensembles constructed by our proposed method over the MBIOS channels. 

This paper is organized as follows. In Section UU we briefly review the BP decoder for non-binary LDPC 
codes. In Section [III] we clarify a necessary and sufficient condition for successful decoding of zigzag cycle 
codes over the MBIOS channel by the BP decoder and propose a design method to lower the error floor. In 
Section [IV] we give lower bounds for the symbol error rates in the error floors for code ensembles constructed 
by our proposed method and show that the proposed method gives better performance than the cycle cancellation 
and the method which uses both the cycle cancellation and the stopping set mitigation [5|. 

II. Preliminaries 

In this section, we recall the BP decoder for the non-binary LDPC codes Q. We introduce some notations 
used throughout this paper. 

A. Channel Model 

Let a be a primitive element of ¥2™ . Once a primitive element of a is fixed, each element in ¥ x m is given 
an m-bit representation [7, p. 110]. We denote the m-bit representation for 7 e ¥2^, by (71, 72, • • • , 7m)- 
Let x = (xi, X2, ■ ■ ■ , xn) denote the codeword over ¥2™. Since each symbol of ¥2™ is given an m-bit 
representation, a codeword is represented as a binary codeword of length Nm, x = (xi 1, £1,2, • • • ,XN,m)- 

We denote the received word by y = (1/1,1 , 2/1.2, • • • >2/AT,m)- A channel is called memoryless binary-input 
channel if 

N m 

p(y 1 x ) = nn^ 1 Xi ^- 
»=i j=i 

It is convenient to transform the binary input alphabet {0, 1} into {+1,-1} by a binary phase shift keying 
(BPSK). With some abuse of notation, we make no distinction between {0,1} and {+1,-1}. A memoryless 
binary-input channel is called output-symmetric if 

p(y I x ) =p(-y I - x )- 
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We assume the transmission over the MBIOS channel. The MBIOS channels are characterized by its L-density 
a JSJ. Examples of the MBIOS channels include the BEC, the binary symmetric channel (BSC) and the additive 
white Gaussian noise (AWGN) channel. 

B. BP Decoder for Non-Binary LDPC Codes 

BP decoding proceeds by sending messages along the edges in the Tanner graph. The messages arising in 
the BP decoder for LDPC codes over F2™ are vectors of length 2 m . Let ^v/ c be the message from the v-\h 
variable node to the c-th check node at the £-th iteration. Let be the message from the c-th check node to 
the v-th variable node at the ^-th iteration. 

1) Initialization: Set I = 0. Let N and M be the number of variable nodes and check nodes in a Tanner 
graph, respectively. For v = 1, 2, . . . , N, let C v = (C v (0), C v (l), ... , C v (a 2m ~ 2 )) denote the initial message 
of the v-th variable node. For 7 6 F2™, the element of initial message C v (pf) is given from the channel output 
as follows: 

m 

C v {l) = X\_¥t(Y v ^ = y Vti I X Vti = ji). 
i=i 

Let jVc(c) be the set of the positions of the variable nodes connecting to the c-th check node. Set for all 

c = 1, 2, . . . , M and v e A/" c (c), 

$(°) = (2-"\2-™...,2- m ). 

2) Iteration: 

a) Variable node action: Let Af v (v) be the set of the positions of the check nodes connected to the v-th 
variable node. The message is given by the component-wise multiplication of the initial message C v and 
the incoming messages $*f ' from check nodes whose positions d are in J\f v (v), i.e., for x € 

*w(x)=k( !C ) n $ c<!», 

? c'eK(v)\{c} 
where £ is the normalization factor such that 1 = Y^xer m ^v,c(x)- 

b) Check node action: The convolution of two vectors vf^ and ^2 is given by 

[*i©*2](x)= *x(tf)*2(«), 

y,z£¥ 2 m :x=y+z 

where 2~2 v , z &w 2m :x=y+z *i(j/)*2(*0 is the sum of ^i(y)^ 2 (z) over all y, z e F 2 »* such that x = y + z. To 
simplify the notation, we define ig{1 2 fc } *» : = *i ® *2 © • • • © *fe- 

Let h c ,v be the label of the edge adjacent to the c-th check node and the u-th variable node. The message 
$c,v is given as, for x € F2™ 

C,U VJ7 v',C' 

«'6A/"c(c)\{«} 
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Fig. 1. A zigzag cycle code of symbol code length s. 



3) Decision: Define 

argmax* := {x | Vy e F 2 m : *(x) > 

and for a; € F 2 m 

^w^jaw n 

where £ is the normalization factor such that 1 = J2 x e¥ 2 ™ D^\x). For v = 1,2, ...,N, let cc^ be the 
decoding output of the u-th variable node. Define 

Z>W := argmaxL>( £) (x). 

x£F 2 m 

If |Z>t^| = 1, the decoding output Xv is the element of T>„ ■ If \Dv \ > 1, the decoder chooses S £>t^ 
with probability 1/|£>^|. 

C. All-Zero Assumption and Defining Failure 

For the MBIOS channels, we assume that all-zero codeword is sent without loss of generality to analyze the 
decoding error rate 0. 

The v-ih symbol is eventually correct iflOll if there exists L v such that for all I > L v , xi^ = 0. The symbol 
error rate is defined by the fraction of the symbol which is not eventually correct. 

III. Condition for Successful Decoding over MBIOS Channel 

A zigzag cycle is a cycle such that the degrees of all the variable nodes in the cycles are two. A zigzag 
cycle of weight s consists of s variable nodes of degree two. The zigzag cycle code is defined by a Tanner 
graph which forms a single zigzag cycle. Figure Q] shows a zigzag cycle code of symbol code length s. In this 
section, we give a condition for successful decoding of the zigzag cycle codes over the MBIOS channels under 
BP decoding. 

We consider the zigzag cycle code of symbol code length s with labels hi t i, /ij.,2, • • • , h s ,i as shown in 
Fig. [T] We define 7, := h~[lhi } i+i for i = 1, 2, . . . , s where h s , s+ \ := h Sj \- Define j3 := Yii=i 7i- We refer to 
the parameter /3 as cycle parameter [6]. The following theorem shows a necessary and sufficient condition for 
successful decoding of the zigzag cycle codes over the MBIOS channels by the BP decoder. 
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Theorem 1: Let a be the order of j3, i.e., let a be the smallest positive integer such that j3 a — 1. We consider 
a zigzag cycle code of symbol code length s defined over F2™ with the cycle parameter f3 over the MBIOS 
channel. In the limit of large £, all the symbols in the zigzag cycle code are eventually correct under BP 
decoding if and only if for all x e Ap := {a? \ j = 0, 1, . . . , 2 — — 1} 

s cr—ls I k— 1 

n^(°)r>nii^ ^n^ 

k=l t=0 k=l \ j=l 

Moreover, in the limit of large £, no symbols in the zigzag cycle code are eventually correct under BP decoding 
if and only if there exists x G Ap := {a 3 | j = 0, 1, . . . , 2 — — 1} such that 

S (T — 1 s / k— 1 

n(^(°)r< nn^ k*n^ 

k=i t=o k=i y j=i 

Proof: First, we write the messages D v by the initial messages C v for the zigzag cycle code of symbol 
code length s with the cycle parameter /3. Let "i^c be the unnormalized message from the v-th variable node 
to the c-th check node at the _-th iteration. For all x £ ¥2^ and i = 1, 2, . . . , s, the unnormalized message for 
the zigzag cycle code of symbol code length s is written as follows: 

:= Ci(a;), ^(z) := Q^i^fr-is), 



where = = *i+ ljS = *i+i, s+ i = *i5 and 7o = 7s . Then, for zigzag cycle code, the 

(£") (£) 

messages < and D\ 1 are written as follows: 

*<<>(., . *!3(f) , Df » (x) . . 

From the definition, we have 

of* (x) = a (x) n I L n 7w j c i+fc ^ n 7 - + ^ J , (d 

where C i+ „ s (x) = Cj(aj) and 7 i+Iis = 7l for rt = 0, ±1, . . . . Define Xi = Ilj=i 7j and 

(T— 1 SIS 

b(x) :=nn c M^n^ 

t=o fe=i y j=fc 

From Eq. (fl}, we have for i = 1, 2, . . . , n 



D^(*) = {fl(x*«)rSr J ( a! ). 



By using this equation, we have 



£)(^»°-+^)(o) = A 2 (°) 

A (f2) (o) + E^f^f 1 } 2 ' 1 IXo 1 £f V) ' 

If 5(0) > for all a; € Ap = {a? \ j = 0,1,..., - 1}, for all i = 1,2,..., a, we have 

lim^oo D t - '(0) = 1, i.e., the decoding is successful. If there exists x G Ap such that S(0) < B(x), for 
all £ = 1, 2, . . . , s we have lirn£_ ! . 00 d\ (0) = 0, i.e., no symbols are eventually correct. 
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Finally, we claim that no symbols are eventually correct, if there exists x £ Ap such that B(0) = B{x) 
Note that for alU > 1 and i e {1,2,..., s}, 

f)(s<Tt) , 

i 



X- X x) ={B(x)} 2i Q( Xt -^) 



Hence for t > 1 and i € {1, 2, . . . , s} 

= {B(0)} 4t 

^'^(OjD^-^fO). (2) 

The i-th symbol is eventually correct if there exist L such that (0) > for £ > L and x € 

F 2 ™. However, from Eq. ©, for all i G {1,2,...}, if D^ CTt " 13 (0) > dI*** -1 ^ -1 ^, then D^' 3 (0) < 
(x^ 1 ^)- Thus, no symbols are eventually correct. This completes the proof. ■ 
By Using Theorem [TJ we have the following corollary. 

Corollary 1: Let a be the order of (3. For a given channel output, if the zigzag cycle with cycle parameter 
j3 such that a ^ 2 m — 1 is successfully decoded, then the zigzag cycle with cycle parameter /3 such that 
cr = 2 m — 1 is also successfully decoded. 

Proof: We consider zigzag cycle of symbol code length s. Since the channel output is given, we are able 
to fix the initial message d for i = 1, 2, . . . , s. From Theorem [T] if the zigzag cycle with cycle parameter j3 
such that a ^ 2 m — 1 is successfully decoded, then for all x £ Ap — {a J | j = 0, 1, . . . , 2 -1 — 1} 

s cr— 1 s / fc— 1 

n(c*(o)r>nn c * 

k=i t=o fc=i y j=i 

From the product of the above equation over all x G Ap, we have 

n n(c*(o)r> n nn c * f^n^ 

sGA^ t=0 fe=l V j=l 

rKCkCo)) 3 "-^ n tick®. 

fe=l cceF 2m \{0} fc=l 

From this condition, the zigzag cycle with cycle parameter /3 such that a = 2 m — 1 is successfully decoded. ■ 
Discussion 1: Corollary Q] shows that the zigzag cycles with cycle parameter j3 such that the order of /3 is 
2™ — 1 have the best decoding performance. We claim that the order of (3 is 2 m — 1 if and only if (3 ^ T-L m , 
where 

H m ~ |J ja 4 ^ |i = 0,...,r-l|. (3) 
Firstly, we show that the order of /3 is 2 m — 1 if (3 ^ W m - For r < 2 m — 1, we define 

«&> := {a 1 ^ |i = 0,...,r-l}. 

If P & Hm , there exist integers i G {0, 1, . . . , r - 1} and j G {1, .. . , (2 m - l)/r - 1} such that (3 = 
a «( 2 -i)/r+j t Hence, we have 

(3 r = Q; W 2m ~ 1 )/ r +-?} r = a? r . 
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TABLE I 

The elements in Hm for m = 2,3, 4, 5, 6. 



Field 


The elements of Mm 


F 22 


1 


F 23 


1 


F 2 4 


1, a 3 , a 5 , a 6 , a 9 , a 10 , a 12 


F 25 


1 


F 26 


1 , a 3 , a 6 , a 7 , a 9 , a 12 , a 14 , a 15 , a 18 , a 21 , a 24 , a 25 , a 27 , a 28 , a 30 , 
a 33 , a 35 , a 36 , a 39 , a 42 , a 45 , a 48 , a 49 , a 51 , a 54 , a 56 , a 57 , a 60 



1(T r 




Fig. 2. The symbol error rate for the zigzag cycle code define over F 2 4 of symbol code length 3 over the AWGN channel with channel 
variance tr 2 = 1. The horizontal line corresponds to the cycle parameter. 



Since jr < 2 m — 1, we get (3 — a? r ^ 1. Thus, we have the order of /3 is not r if j3 £ Hm . Since the order 
of (3 is less than or equal to 2 m - 1 for /3 e F 2 m \ {0}, the order of (3 is 2 m - 1 if (3 £ H m . Secondly, we 
show that f3 $ Hm if the order of j3 is 2 m — 1. Obviously, the order of j3 £ is less than or equal to r. 
Hence, the order of f3 g H m is less than 2 m — 1. From the contraposition, (3 ^ H m if the order of f3 is 2 m — 1. 
Therefore, we see that the order of (3 is 2 m — 1 if and only if (3 ^ H m - 

Thus, the zigzag cycles with the cycle parameter (3 $ H m have the best decoding performance. Note that 
{a 1 ^ 2 -1 )/ r | i = 0, . . . , r — 1} represents a proper subgroup of F2^. Table [I] shows the elements in H m for 
m = 2,3, 4, 5, 6. Figure [2] shows the symbol error rate for the zigzag cycle code define over F 2 4 of symbol 
code length 3 over the AWGN channel with channel variance a 2 = 1 . From Figure [2] we see that the zigzag 
cycle codes with the cycle parameter (3 ^ H4 have the best decoding performance. 

By using the log-likelihood ratio, Theorem[T]is simplified for the zigzag cycle codes with the cycle parameter 
j3 g U m over the MBIOS channel. 

Corollary 2: We consider the zigzag cycle codes of symbol code length s with the cycle parameter f3 ^ T-L m 
over the MBIOS channel. Let Z v ,i(Y v ,i) be the log-likelihood ratio corresponding to the z-th channel output in 
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the u-th variable node, i.e., 

Pi(Y v>i | X Vti = 1) 



Z Vt i(Y Vi i) = log • 



Pr(Y„, i | X Vii = -1) 

In the limit of large I, all the symbols in the zigzag cycle code are eventually correct if and only if 

s m 
v—l i—1 

Moreover, in the limit of large £, no symbols in the zigzag cycle code are eventually correct if and only if 

s rn 
v— 1 i—1 

Proof: To simplify the notation, we define for k g {1, 2, . . . , s} and i G {1, 2, . . . , m} 

Pfc,» :=Pr(Yfc,i | = 1), 
Pk,i :=Pr(Yfc : i | X/-,i = -1). 

Note that for k € {1, 2, . . . , m} 

m 

Ck(0) = JJPM. 

i=l 

2 m -2 / fc-1 \ 

n^ ^n^ = n 

t=Q \ s=l / x<EF 2 ™\{0} 

m 

From Theorem Q] all the symbols in the zigzag cycle are eventually correct if and only if 

s 2 m — 2 s / 

n(c fc (o)) 2m - i > n n^^n^ 

fc=l t=o fc=i y j=i 

s m s m 

<=► niK 1 n ik /C 

fc = l 2=1 fc=l 1=1 

s rn 
fe=l »=1 

Hence, we see that all the symbols in the zigzag cycle code are eventually correct if and only if J2t=i YliLi ^M(^fc,i) > 
0. Similarly, no symbols in the zigzag cycle code are eventually correct if and only if J2k=i ^mC^m) — 

0. ■ 
Let P zz (s, m, a) be the symbol error rate for the zigzag cycle code defined over F2™ of symbol code length 
s with cycle parameter (3 £ H m over the MBIOS channel characterized by its L-density a under BP decoding. 
Let ai,a2,...,afc denote independent and identically distributed random variables with density function a. 
Define :— 2i=i a i- From Corollary [2] we have the symbol error rate of zigzag cycle code is given by 

P zz (s,m,a) = Pr(Z( sm > < 0). (4) 

Figure [3] shows the symbol error rate for the zigzag cycle code defined over F 2 4 of symbol code length 3 
with the cycle parameter j3 ^ H4 over the AWGN channel. The circles in Figure [3] show the simulation results. 
The continuous line shows the theoretical symbol error rate. For the AWGN channel with channel variance ct, 
the theoretical symbol error rate of the zigzag cycle codes defined over F 2 4 of symbol code length s with cycle 
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Fig. 3. Symbol error rate of zigzag cycle codes defined over F 2 4 of symbol code length 3 with cycle parameter /3 H4. The continuous 
line shows the theoretical symbol error rate. The circles show the simulation result. 



parameter j3 £ H m is given by Q(^p-), where Q(y) — exp[— ^-}dx. From Figure[3] we see that the 

the theoretical result gives the symbol error rate of zigzag cycle code with the cycle parameter (3 ^ T-L m - 

IV. Analysis of Error Floors 

In the previous section, we give a condition for the decoding error to the zigzag cycle code. By using this 
result, in this section, we give lower bounds of the symbol error rates in the error floors of non-binary LDPC 
code ensembles over the MBIOS channel under BP decoding. 

A. Code Ensemble 

A stopping set S is a set of variable nodes such that all the neighbors of S are connected to S at least twice. 
Since the stopping sets depend only on the structure of a Tanner graph, we are able to extend the definition of 
the stopping set for the non-binary LDPC codes. Obviously, the zigzag cycles form stopping sets. 

It is empirically known that (2, fc)-regular non-binary LDPC codes exhibit good decoding performance among 
other LDPC codes for g > 64 [4]. However, this is not the case for q < 64. In this paper, we consider the irregular 
non-binary LDPC codes which contain variable nodes of degree two for the generality of code ensemble. Note 
that the (2,fc)-regular non-binary LDPC code ensembles are included in the irregular non-binary LDPC code 
ensembles which contain variable nodes of degree two. 

From Discussion [1] we see that the cycle parameter /3 is an important parameter to improve the decoding 
error rate in the error floor. The following definition gives expurgated ensembles parameterized by the cycle 
parameter (3. 

Definition 1: Let LDPC(A r , to, A, p) denote LDPC code ensemble of symbol code length N over F2™ 
defined by Tanner graphs with a degree distribution pair (A, p) O and labels of edges chosen elements 
from F2™ \ {0} with equal probability. Let s g £ N be an expurgation parameter. The expurgated ensemble 
ELDPC(A r , to, A, p, s g ) consists of the subset of codes in LDPC(iV, m, A, p) which contain no stopping sets 
of weight in {1, ...,s g — 1}. Note that the expurgated ensemble ELDPC(A^, to, A, p, 1) is equivalent to 
LDPC(iV, to, A, p). Let s c e N be an expurgation parameter for labeling in the Tanner graph, where s g < s c . 
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Define expurgated ensemble £(N,m, A, p, s g , s c ,H) as the subset of codes in ELDPC(7V, m, A, p, s g ) which 
contain no zigzag cycles of weight in {s g , . . . , s c — 1} with the cycle parameter j3 £ H. 

Recall that a is a primitive element of F2™ . Define H m as m Eq. (0). Note that the expurgated ensemble 
constructed by our proposed method and the cycle cancellation is represented as £(N, m, A, p, s g , s c , H m ) and 
£(N, m, A, p, s g , s c , {1}), respectively. 

B. Analysis of Error Floors 

In this section, we analyze the symbol error rate in the error floors for the expurgated ensembles defined in 
Definition Q] The following theorem gives a lower bound on the symbol error rate under BP decoding for the 
expurgated ensemble £(N, m, A, p, s g , s c , W m ). 

Theorem 2: Let P s (£,a) be the symbol error rate of the expurgated ensemble £(N, m, A, p, s g , s c , Hm) 
over the MBIOS channel characterized by its L-density a under BP decoding. Let 3i, 82, . . . , &k denote 
independent and identically distributed random variables with density function a. Define := Y^i=i a * 

and p := A'(0)//(1). Let 25(a) be the Battacharyya functional, i.e., 25(a) := J a.(x)e~ x ^ 2 dx. The symbol error 
rate for sufficiently large N and 03(a) < pr 1 '™ is bounded by 

,00 / 1 \ 

P.(£,a) > — M s Pr(^ m) < 0)+o(-Y (5) 

S — Sg 

Proof: Let P(£, a) be the symbol rate rate caused by the zigzag cycles under BP decoding over the MBIOS 
channel with characterized by its L-density a for £ (N, m, A, p, s g , s c , Ti). Hence, we have 

P B (£,a)>P(£,a). 

We will consider P(£,a). Let P\[£ ,a, s) be the symbol error rate caused by the zigzag cycles of weight s 
under BP decoding over the MBIOS channel with characterized by its L-density a for £(N, m, A, p, s g , s c , H). 
For the expurgated ensemble £(N, m, A, p, s g , s c , T-L), the weights of zigzag cycles are at least s g . By [8, C. 37], 
if we fix a finite W and let N tend to infinity, the zigzag cycles of weight at most W become asymptotically 

non-overlapping with high probability ]8] p. 155]. Hence, for fixed W and sufficiently large N we have 

w 

P(£,a)> ^A(£,a, s ). 

S = Sg 

From Corollary |2 no symbols in zigzag cycle codes of weight s with cycle parameter f3 £ W m are eventually 
correct if Z^ sm ^ < 0. The symbol error rate for the zigzag cycle codes with j3 H m is smaller than that for 
the zigzag cycle codes with (3 £ Hm- Hence, no symbols in the zigzag cycle of weight s are eventually correct, 
with probability at least Pr(Z( sm ) < 0). By [8, C. 37] for fixed W, the expected number of zigzag cycles of 
weight s < W is given by p s /2s, for sufficiently large N. Each zigzag cycle of weight s causes a symbol 
error probability s/N . Hence, for sufficiently large N, we have for s £ {s g , . . . , s c — 1} 

A(£,a,s) = ^Pr(V s ™) <o) (6) 

and for s e {s c , . . . , 

A(f,a,«) > ^M s Pr(V sm) < 0) (7) 
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Thus, we have 

w 



P s (£, a) > P(£, a) >-L £ ^(z (sm) < o) + o( i 



2N n V -J \N 

S = Sg 

Note that Pr(Z( sm ) < 0) < {05(a)} s "\ Hence, we have 

^^^Pr(z^)<0)<^E(^(a)r 

S — Sg S Sg 

Thus, if 05(a) < yTm and W tends to infinity, the left hand side of this inequality converges. 
Corollary 3: Define 

| for n < 1, 



— 2^ for /u > 1. 

For the BSC with crossover probability e and e < e* n , the symbol error rate is lower bounded by 

s=s c Kms/2 V 7 V 7 

Corollary 4: Define 

3 for fj, < 1, 



afihl for ^> L 

For the AWGN channel with channel variance cr 2 and cr < <r* n , the symbol error rate is lower bounded by 

where Q(j/) = /J' exp[-^]dx. 
C. Simulation Results 

In this section, we compare the symbol error rate in the error floor for the expurgated ensemble constructed 
by our propose method with (i) that constructed by the cycle cancellation Q in Section HV-Cl I and IIV-C2I and 
(ii) that constructed by the combination of the cycle cancellation and the stopping set mitigation |5| in Section 
IIV-C3I 

1 ) AWGN Channel Case : First, we show the cases for regular non-binary LDPC code ensembles. From Table 
ID we have Hi = {1, a 3 , a 5 , a 6 , a 9 , a 10 , a 12 }. Figure|4]and|5]compare the symbol error rates for the expurgated 
ensembles constructed by our proposed method £(315, 4, x, x 2 , 1, 8, T~La) and £ (1200, 4, x, x 2 , 2, 11, Hi) with 
the expurgated ensembles constructed by the cycle cancellation [5 1 £(315, 4, x, x 2 , 1, 8, {1}) and £(1200, 4, x, x 2 , 2, 11, {1}) 
respectively. The lower bounds on symbol error rate are given by Eq. (0. Figure[5]is the case for s s > 1. We see 
that our proposed codes exhibit better decoding performance than codes designed by the cycle cancellation. We 
see that Theorem [2] gives tight lower bounds for the symbol error rates to the expurgated ensembles constructed 
by our proposed method in the error floor. 

Next, we show the case for an irregular non-binary LDPC code ensemble. As an example, we employ the 
degree distribution pair A = 0.5a: + 0.5x 2 and p = Q.5x 3 + 0.5a; 5 . Figure [6] compares the symbol error rate for 
the expurgated ensembles constructed by our proposed method £(1000, 4, A, p, 1, 8, Hi) with the expurgated 
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ensembles constructed by the cycle cancellation. £(1000, 4, A, p, 1, 8, {1}). The lower bounds on the symbol 
error rates are given by Eq. ([9j. We see that our proposed codes exhibit better decoding performance than codes 
designed by the cycle cancellation. We see that Theorem [2] gives a tight lower bounds for the symbol error 
rates to the expurgated ensembles constructed by our proposed method in the error floor. 

2) BSC Case : Figure [7] and [8] compare the symbol error rates for the expurgated ensembles constructed by 
our proposed method £(315, 6, x, x 2 , 1, 8, Hq) and £(1200, 4, x, x 2 , 2, 11, H4) with the expurgated ensembles 
constructed by the cycle cancellation £(315, 6, x, x 2 , 1, 8, {1}) and £(1200, 4, x, x 2 , 2, 11, {1}), respectively. 
The lower bounds for the symbol error rates are given by Eq. (0. Figure [8] is the case for s g > 1. From Fig. [7] 
and [8] we see that our proposed codes exhibit better decoding performance than codes designed by the cycle 
cancellation. 

We see that Theorem [2] gives tight lower bounds for the symbol error rates to the expurgated ensembles 
constructed by our proposed method in the error floor. 

3) Comparison with Stopping Set Mitigation : In (5 |, Poulliat et al. also proposed the stopping set mitigation. 
To lower the error floor further, Poulliat et al. proposed to use both the cycle cancellation and the stopping set 
mitigation. We refer to the Hamming weight of the binary represented non-binary codeword as binary weight, 
the binary represented non-binary vectors. The stopping set mitigation is a method to design the labels on the 
edges, which are connecting to the nodes in the smallest stopping set, so that the binary minimum distance in 
the stopping sets takes the maximum value. 

Figure [9] compares the symbol error rate for the codes designed by the proposed method and the codes de- 
signed by the method which uses both the cycle cancellation and the stopping set mitigation |5 1. In order to make 
the stopping set mitigation work effectively, we employ as the base codes the codes whose Tanner graphs include 
many small stopping sets. For example, this condition is met by the code ensemble ELDPC(60, 4, x, x 3 , 3). 
By applying our proposed method and the method which uses both the cycle cancellation and stopping set 
mitigation, we get resulting codes which are the subsets of ELDPC(60, 4, x, x 3 , 3). We see Figure [9] that the 
symbol error rate for our proposed method is lower than that for the method using both the cycle cancellation 
and the stopping set mitigation. 

V. Conclusion 

In this paper, we provide a necessary and sufficient condition for successful decoding of zigzag cycle codes 
over the MBIOS channel by the BP decoder. Based on this condition, we propose a design method of selecting 
labels so as to eliminate small zigzag cycles which degrade decoding performance for non-binary LDPC codes. 
Finally, we show lower bounds of the error floors for the expurgated LDPC code ensembles over the MBIOS 
channel. 
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Fig. 4. Comparison of the symbol error rate for the expurgated ensemble £(315, 4, x, x 2 , 1, 8, H4) (proposed) with the expurgated 
ensemble £(315, 4, x, x 2 , 1, 8, {1}) (cycle cancellation). The lower bound is given by Eq. j5}. 
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Fig. 5. Comparison of the symbol error rate for the expurgated ensemble £(1200, 4, x, x 2 , 2, 11, H4) (proposed) with the expurgated 
ensemble £(1200, 4, x, x 2 , 2, 11, {1}) (cycle cancellation). The lower bound is given by Eq. {g}. 
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Fig. 6. Comparison of the symbol error rate for the expurgated ensemble £(1000, 4, A, p, 1,8, ^4) (proposed) with the expurgated 
ensemble £(1000, 4, A, p, 1, 8, {1}) (cycle cancellation), where A = 0.5x + 0.5x 2 and p = 0.5x s + 0.5a; 5 . The lower bound is given by 
Eq. 49). 
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Fig. 7. Comparison of the symbol error rate for the expurgated ensemble £(315, 6, x, x 2 , 1, 8, He) (proposed) with the expurgated 
ensemble £(315, 6, x, x 2 , 1, 8, {1}) (cycle cancellation). The lower bound is given by Eq. <fS>. 
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Fig. 8. Comparison of the symbol error rate for the expurgated ensemble £(1200, 4, x, x 2 , 2, 11, H4) (proposed) with the expurgated 
ensemble £(1200, 4, x, x 2 , 2, 11, {1}) (cycle cancellation). The lower bound is given by Eq. {8). 
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Fig. 9. Comparison of the symbol error rate for the codes designed by the proposed method and the codes designed by the method 
which uses both the cycle cancellation and the stopping set mitigation. The base code ensemble is ELDPC(60, 4, x, x 3 , 3). The curve 
(proposed) shows the symbol error rate for the codes designed by our proposed method. The curve (ssm) shows the symbol error rate for 
the codes designed by the method which uses both the cycle cancellation and the stopping set mitigation. 



